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SUMM&ai 


The paper proposes a method for decomposing large optimization problems 
encountered, in the design of engineering systems such-as an aircraft into a 
number of smaller, subproblerot. The decomposition is achieved- by organizing 
the problem and the subordinated subproblems in a tree hierarchy andu (1) 
minimizing the constraint violation- in each subproblem using its. local design 
variab-leS while holding, constant the h-igher level variables which figure as 
parameter.s in the subproblem minimization, (2) calculating the sensitivity^ 
derivatives of the subproblem minimum solution to the parameters, (3) using 
the derivatives to form a linear extrapolation ot-each subproblem minimum with 
respect to the higher level vari-ables, (4) optimizing the system for its- 
objective function and constraints, including the linear extrapalation of each 
subsystem constraint violation minimum ir lieu of repeated subsystem 
minimizations, (5) repeating operations (1) through (4) until convergence is 
attained 

The decomposition Is introduced for a two-level system and generalized to a 
multilevel case. A formalization of the procedure- suitable for computer 
implementation is developed and the state of readiness of the implementation — 
building blocks is reviewed showing that the ingredients for the development 
are on the shelf. The decomposition method is also shown to be compatible 
with the "natural" human organization of the design p.rocess of engineering 
systems. It is, thereforoj viewed as. an opportunity to bring mathematical 
rigor to that process without' overturning its time-honored organizational 
structure* The method is also examined with respect to the trends in computer 
hardware and software progress to point out that its efficiency can be 
amplified by network computing using parallel processors. A few numerical 
examples drawn from the areas of structures and aircraft design are given to 
illustrate the salient conceptual points of the method. While the full 
validation of the method still remains, its presentation here provides a guide 
to its development and test applications, and an opportunity to elicit 
comments, critiques, and improvements to a basic concept. 


LIST OF SYMBOLS. 


Variables 

For some^ variables,. notation is given in shorthand and longhand forms and 
upper and lower casci e.g.j B, B(NLO); Gj.g-j. 

A cross-sectional area 

B, B(NID) vector of behavior variables at node-NID 

CID _ identification of a-oonstraint vector 

E, E(CIO) vector of equality constraints 

Ej,ej eleinent-of {E} 

F, F(V,H) objective function 

f function in a— general mathematical sense, also objective 

function 

6, G(CID) inequality constraint 

Gj, gj element of {G} 

H, H(NID) vector of parameters 

Hj, hj element of |H} 

1 cross-sectional moment of inertia 

K stiffness matrix 

NIO node identification in general, NID is a vector NID = 

(u,v}, where u is the node level number (u=l is system 
level), V is the node position in its level counted from 
left (.e.g, fig. 5 and Table II) 

NQI(SSIDi,SSID 2 ) network interaction quantity representing influence of 
subsystem SSID^ on subsystem SSID 2 

P cumulative measure of constraint violation (cumulative 

constraint, penalty term) 

P$ P for a node playing the role of a system 

Pi P for a node SSIDj playing the role of subsystem 



Plfl same as-NIO» used whenever the node is discussed— io_its - 

parent role 

QI, QI(P10,SSID> 'ector of u».teraction quantities represent ing_JLn±luence of 

parent system PtO on its subsystem SSID 

RQJ, RQI(R1D,SSID) vector of interaction quantities representing influence of 

a subsystero-SSIO on its parent- system PID 

SSID same as NID, used whenever the node is discussed in its 

subsystem role, A subscripted form, e.g„, SSlOi, SSID? 
is used to distinguish two different SSlD vectors 
corresponding to two subsystems 

V vector of design variables in general ,_j«ay denote X or Y 

or both 


Vi 

X, X(PIO) 


Xi 


xi 
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element of vector V 

1. vector of design- variables of a node playing the role 
of parent to its subsystems 

2. vector of parameters in a Subsystem optimization (see 
definition of H) 

subscripted form of X, e.g* Xi and X? used to 
distinguish vectors X for different nodes 

element of vector- X 

element of vector Xi 


Y, Y(SSID) vector of design variables of a node playing the role of a 

subsystem 

Yi subscripted form of Y, e.g., Yi and Y 2 * used to 

distinguish vectors Y for different nodes 

yi element of vector Y 


Constants 

k number of the system level constraints 

n number of design variables 

m number of constraints in general 

q number of elements in vector {x^} 

^2 number of subsystems in a multilevel system 


V 


& 


denotes-an incmnent of a. variaWe, e.g.: 6 xi 

a s<na41 positive constant 


SuJwcripis^ Superscripts 

B — initial value of P 
e extrapolated value 

L 1 ower bound 

i as a subscript; position of design variable in a vector of variables; 

a general purpose subscript; as a superscript: Identifies a subsystem’ 
to which the variable pertains 

j position of a constraint in a vector of constraints; a general purpose 

subscript 

0 initial value from which one extrapolates 

p perturbed value 

r general purpose subscript for a vector element 

q value of in iteration q 

Q number of decrements for reducing P 3 to zero 

s system quantity 

t target value to which P is to be reduced 


roiiyms , 

(JAC(^AQ), 0AC 

0AQ((X,H),(QI,RQI.Nm)),jaAQ 

tJASW(OAW) .jJASW 
0OBJ((X),(H,F)),PO8J 
0 OPT„,((H).(v,<.)). 0OPT„, 
0SEN((H,V,(i.),(3V/3Hj,3<|)/3Hj)),0SEN 
(JSUBSW(00PT1 ,0SEN) .0SUBSW 


Special Symbols 

constraint operator (see subsection 
Operators, section FORMALIZATION...) 

interacton ana-lysis op(>rator, first 
parenthesis-input, second parenthesis 
output 

interaction analysis sweep operator 
objective function operator 
optimization operator (m-l, or m- 2 ) 
opt'! mum sensitivity analysis operator 
subsystem elimination sweep operator 



^TER 

procedure terretoAtioe. oporatPr 


PS 

parent system 


SS 

subsystem 


^^u,y_ 

subsystem Identified by subscripts 

defined in SSID 

STO 

subject to 


character 

overbar indicates the optimum value 
solution) 

(constrained minimum 

character 

tilde indicates the system quantity 


* Hit 
9 

before and after one iteration 
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liitRODUaJQN 


The purpose of this report is to propose a. methocUfor decomposing a Urge 
optisiization problem- into a hierarchy of much smaller subproblems, and to- 
provide a blueprint for development- of a eomputer implementation for the 
method. Several, general purpose>oriented, decomposition schemes based on 
various sets of- restrictive assumptions have been proposed. Some of them are- 
described in ref. -1 in which numerous sources, are also quoted.. In addition, 
decomposition schemes specialized. for structural optimization- have also been 
introduced (e.g.., ref. 2 and However, there seems to be no scheme 
available that would be adequately general, and efficient to meet the need for 
optimization of large multidisciplinary engineering systems.- In absence of 
such a scheme, an attempt to perform such-optimization using disciplinary 
analyses of a significant depth would saturate even the most advanced 
optimization software-hardware systems available today. 

There is ample motivation for undertaking development of a scheme for 
optimiration of large multidisciplinary engineering systems at this time. On 
one hand there is a need to bring mathematical optimization methods to bear on 
truly large engineering design problems, for example synthesis of aircraft as 
multidisciplinary engineering systems. On the other hand, there is an 
opportunity brougilt about by recent theoretical and computer technology 
developments. Some of these developments aret (1) approximate analysis and — 
variable Unking (e.g.-, ref. 4), (2) analytical generation of gradient 
information (e.g., refs_4, 5, 6, 7, 8), (3) piecewise-1 inear optimization of 
nonlinear problems (e.g., refs. 9, id),. (4) reduction of the multitude of 
constraints to one cumulative-constraint (e.g., ref. 8), (5) sensitivity 
analysis of optimum solutions (ref. 11), (6) development' of distributed 
(network) computing involving relatively inexpensive mini and microcomputers 
linked with mainframe computers (ref. 12), and employing comprehensive data 
management systems (ref. 13). 

It appears that the desired capability can be developed in a way d«>scribed in 
this report. The report begins with an introduction of the linear 
decomposition principle in a narrative form, with a minimum of mathematics, to 
establish an understanding of the basic idea which is very simple. Next, a 
formalization of the basic idea into a procedure suitable for computer 
implementation is given including i dent itica-t ion of all the- building blocks, 
their state of readiness, and- discussion of the development work required to 
make each block ready for i-ntegration in the procedure. Specifications for 
the verification testing are presented to establish testing as one of the 
critical stages of the development. Finally, compatibility of the proposed 
method with the organization of a typical design office is discussed to show 
that the method supports the natural tt: dency of engineers to work in 
concurrently operating specialty groups, each dealing with a limited part of 
the problem, and that it can exploit the parallel processing capability of a 
distributed (network) computing. 

The paper offers no numerical examples for execution of the entire method 
because such complete examples will require completion of the very development 
outlined herein. However, partial examples are used to illustrate salient 
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KEY IDEA FOR THE DECUMPOSJTION 


problem under consideration is a general nonlinear 

^ Srdesfgn " 


STO (subject to) 


rnin F(V) 

{V 

gj{V)^0, j = 1 ^ m; 


(1) 


5L?r"'“ 

srit’Ss?Va" 

level of ah^trlrt inn if * ■ • ^’ ^ presented at a completely qeneral 

l:o!!o;L=!ranTs:dse^::j^;.-^^^ 


Introductory Example 

sys't™*"°Tl1?aS;rk1s°"Lde u'p'orthV« 

cannr?ec%“Ssrt:?: i",r; 

forces shown in fig. 2, can be carried 'out°with°' ^'?l’!a''«'"dat5, and internal 

rs, hs-r -■•srrrA“"“S ~ ~ 

J?oble“m*or?8'«r!a"bles‘L?o1'2ne^ "all-in-one" optindtation 

cr„ss!sectionardi:eisi™s‘:’L’,o"''l®p?o ie“: :rr^r2)°sv"tTi"“ f' 

iterative pLedu?e ma^be^summa?^ h°e ?o?L1So% 

separately for each of the two levels: following sequence or steps shown 
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System level - whole tramework 

Component (subsystem) level - 
each sepai ate beam 

1. Oefiae loads. 

1. Initialize detai led-4l1inensions. 

2, Deftee dlsplaccmont constea4nts. 

2. Compute A»_Iy for each beam. 



Is, Move to the system level. 

4. Analyze the framework to eomputo 

its displacements and che-end 
forces (N,M,T,_fig. 2) on each 
beam. Compute derivatives of 
these quantities with respect to 
the A, ly of each beam. 


5, Move to the component level. 



6. For beanr 1, hold constant the end 
forces- N, M, T and the values 
A and 4y* 


Analyze the beam to eva-luate its 
constraints such-as stress and 
local buckling. 


Form a single measure of the 
constraint violation using, for 
example, an exterior penalty 
function. 


Optimize 6 cross-sectional 
dimensions as subsystem design 
variables to minimize the measure 
of constraint violation as an 
objective function subject to 
minimum gage and other side 

constraints* including equality 

constraints on A and ly. 

The equality constraints assure 
that the beams A and ly 
computed from the cross-sectional 
dimensions are equal to those 
prescribed at the system level. 

( 

For optimized beam, compute de- 
rivatives of the minimized meas- 
ure of the constraint violation 
and the subsystem design vari- 
ables with respect to the con- 
stants: N, M, T and A, ly. 
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H. Hppoat from 6 . 


‘i. 


. Approximate the minimi /oh 

measures of the constraint vioia 
tiofl in each beam as linear font 
tions of () quantities A and 
ly by a linear lay lor expansion 
using the derivatives computed 
in step /. In this expansion 
each of the end forces N, M, T 
is also approximatffd as a linear 
function of all 6 quantities A, 
and ly using derivatives com- 
puted in step 4. 


Move to the syutom level > 


Optimize 6 system level variables 
A, ly, to minimize structural 
mass subject to: 

a) framework displacement con- 
straints approximated as func- 
tions of A and ly by 
linear Taylor expansion using I 
derivatives computed in 

step 4. 

b) constraints r-equiring that the 
mini mi zed measure of the con- 
straints violation in each 
beam be reduced by a pre- 
determined decrement. 

c) move limits on the variables 
A and ly to p''otect 
accuracy of the linear Taylor 
expansions and to account for 
side constraints of the sub- 
system design variables. The 
latter are approximated as 
functions of A and ly by a 
linear Taylor expansiori using 
derivatives computed in 

step 7. 

d) side constaints on A and 


and 
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Repeat from /l-wit.h Uie sysitem 
level (lesiyn varidbles A ,ind 
ly obtained in step 11, and the 
corresponding approximate sub- 
system design variables estimated 
by a linear extrapolation as 
described in step lie. 

Terminate when: 

a) the framework displacements 
are within constraints. 

b) the minimized measure of con- 
straint violation for each 
beam is reduced to at least 
zero. 

c) no further reduction of the 
framework mass appears 
possible. 



The procedure differs from refs. 2 and 3 In the formulations of the subsystem 
and system level ont /afions (steps 6 U) and the way the two levels are 
linked by means of tir’ uptimum sensitivity analysis (steps 7 and 10). 

The framework example given here in a purely descriptive manner is repeated in 
Appendix cast in the formulation of the general decomposition method 
presented herein. To provide more examples for the salient points of the 
method, y\ppendix A describes also two other applications, including a case of 
an aircraft viewed as a multidisciplinary system. The method will now be 
introduced at an abstract level and freguent reference to Appendix A is 
recommended as the discussion unfolds. 


Two-Level System Optimization 

A two- level system, that does not have to be a structure, is depicted-in 
figure 3 by a Venn diagram showing a system with a number of subsystems 
connected to it, so that the variables X = { Xj ,X 2 »...X'j...} are system 
design yaria^'les and variables are subsystem design variables. By 
definition, X^ are those variables whose values must be known to analyze 
the system to obtain the relevant behavior variables and the objective 
function, and Yj are those variables whose values are not needed to 
perform that analysis, although they are needed for analysis of subsystem i. 

An optimization problem posed for the system together with its subsystems 
calls for finding values of the design vaj'iables jX} and {Y} that minimize 
an objective function subject to constraints on the behavior variables in the 
system and all the subsystems. In principle, the problem can be solved by 
collecting all elements of | X| and (Yj in one vector of design variables 
such as vector {V} in eg. 1, to be manipulated by an appropriate 
optimization algorithm coupled in an iterative loop with an analysis algorithm 
which evaluates the objective function and all the constraints. 

In contrast to this "all-in-one" approach, a decomposition approach separates 
the system and subsystem optimizations into an iteratively executed sequence 
of steps, each described in one of the following subsections. 

System analysis .- For the values of system variables X^j prescribed by an 
optimization algorithm and other required inputs, the system is analyzed. The 
analysis outputs the system constraints, objective function, and the 
information needed as inputs for analyses of each subsystem. 

This implies a simplifying assumption that the system is strictly hierarchical 
so that information generated by system analysis satisfies input requirements 
for the subsystems below but the system analysis Input does not depend on the 
outputs from the subsystem analyses, and, similarly, output from analysis of 
one subsystem is not needed as input fo»' analysis of another subsystem. In 
other words, the influence of one component of the system on another is 
restricted to a top-down influence with no reverse and lateral influences 
allowed. 
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systems are networks and,, consequently, 
tne re^rse and lateral influences do exist. -Therefoce. the simoUfvfRo ^ 

thrbXiTcoSceot‘‘coSMl only temporarily used to keep the introdiction of 
reverb : section, the means to accommodate the 
u . . ^ Idtcrdl influ6nC0S 3r6 d6flD0d« dnd it is 0 XDVdin 0 d in Ani^ndiy R 
how these influences can be included in the basic concl^f Append.ix B 


90s . - When the system‘s analysis- is completed, each 

“i^the variables^^x"*^^!r«>^k 0 ^ separate subproblem ''i.'' In each subproblem 
<;nimht fn kept Constant and the design variables Yi are 

not^the same function. The subsystem objective function is 

penally fLct^on (fers)?''"''^""^'’" 


*i(<9j>)^ 

«l 


<9j> = 


9j. If 9j>0^ 
0.0, if~9j40. 


( 2 ) 


rnH^wii?^K ^^0 squares of violated constraints g| in subsystem 
s suJ Jrj t " cumulative constraint. Minimil^tiSnT^?^ 

and lower bound limits on elements of (va and equality 
constraints are required to maintain a constant {xj, Thek equality^ ^ 
constraints arise from the functional relationship ^ 


f^il = f({fi}). OP f({X^}, {Y^}) * 0 


(2a) 
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Of the orols-sect(oLfX„1fonr?i aTo^oSTSsfAL^^I/S ^ '^‘1?“ 
Thus* the subsystem opt’imlz'atiofv is ^ L> •> n Appendix A)* 


1 ^il 


STO: {Yi}ln< {Yi} « {Yilu 

®j n Yf } , { } ) = 0, j = 1 •*• 


( 3 ) 


on 


optimization prS IL SpecufSIlv of the 

iVil »1th netpVt to-e.etSr’5 fi^| 5:f aT ^gJaf^^r^llSe^nria.^"- 

linear extrapolations: ^ 


as 


(Pi)e = (Pi)o + vP^T{ 5 x^} 


(4a) 


(Yi)e = (^i)„ + yvYjix 

r=l r 


(4b) 


l^5'’7°i'r'°Hto*f3ncJlon" 0^100 ?^s?orie«l 'willbfli^r J'’’"*'"" 

section, the increments 6x^ afe'variables^i^a fn "ext 

system level optimization wiiose sta?tl'5 p^i,^t ?s 3enSL 'l?®! 
functions shown in eq. 4 will be referr^a fn ^ ^“.eetmed by {Xq}. The 

sobsystem i. hence, the nanm of the .Inea^'d^oIjSnuo^^m^tho;!'’”" 
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System optimization .- Aftef^ all tite suljsystems have beeru optimized and their 
linear representations establ tshed , it is the system's turn to be_optiliitzed. 

In this optimizatwn, one seeks values of the elements. ot_ {fiX} to minimize 
an nbjeetlye function F(X) subjecfto constraints. 

The constraints are: 

up per a nd lower limits on elements of {X} 

2. upper and lower limits on elements of {Y^} vectors for all 
subsystems 

3. requirement that the sum of the measures- of unsatisfaction of the 
system and subsystem constraints be reduced by a predetermined 
amount. 

Constraints 1 are ordinary side constraints. Constraints 2 are similar to 
move limit:s used in optimization by means of sequential piecewise 
linearization (e-.g., ref. 10) and are required to prevent deterioration of the 
extrapolation accuracy (eq, 4) beyond an accep^table limit. Constraint 3 is a 
cumulative constraint defined in eq. 2 but generalized to encompass the system 
and all of its subsystems, so that it becomes 


P = Ps . j;p( (6) 

i 

where Pg = represents the system constraints,. Specifically, 

constraint 3 is written as a single constraint in terms of P: 


G(X) = P-Pt^O 


( 6 ) 


where P is computable as a function of {6X} because Pg in eq. 5 can be 
obtained -from analysis of the system which yields the values of gj, and the 
term ][P.i in that equation is a linear function of {fiX} via eq.'*4. The 
P^ quantity is a target reduction of the constraint unsatisfaction 
established by prescribing a reduction schedule for P at the beginning of 
the whole process. For example, if a reduction schedule were set to decrease 
P from an initial value of Pg to zero in Q equal decrements, then a 
Pt<l for iteration q would be: 

P? = Pb - i(Pb/Q) = Pb(i-q/Q) (7) 

Thus, the system optimization has the meaning of finding {6X} that reduce 
the total constraint unsatisfaction by a predetermined amount while minimizing 
the objective function. 
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In-a concise notation, It is 


min F (<SX) 

{6X} 

STO: {X)l,< {X} ,< {X}u 


(8a) 

(SD) 


l^ilU'^ {Yj} 4 {Yil'j. 1 » 1 +S 2 (8c) 

6(6X) = P-Pt^< 0 

When, a solution (6X} is found., one increments variables {X} and 1Y<1 
the latter via eq. 4b. ^ ' ‘ ’ 

process and its termination .- The optimization procedure terminates 

when tje system optimization y elds F • F„,„. withfn constraints 1 en” 2. 

with iL^ ‘*>e analysis of tbe- system 

With new {X| and (Y,} obtained in the most' recent Subsystems and system 

optimizations is repeated and the procedure continues until convergence. The 

sections”^^ considerations will be discussed further in the following 

Consistent with the exterior penalty approach used in eq. 2, the procedure 
cannot progress unless a nonzero cumulative constraint value exists to be- 
reduced in eq. > and b. Consequently, the initial design must be infeasible 
with respect to at least one local or system constraint. 


r?!!! two-level system o ptimization .- The decomposition approach 

then, 1eeds to an iterative process in which: 

1. The s.v stem and subsystems are initialized in the infeasible domain, 
system level optimization are interspersed between the series of 
subsystem optimizations. Each optimization involves a number of 
design variables smaller than that-required by the "all-in-one" 
approach. 

The objective function is entirely controlled by variables {X} at 
the system level and never figures in the subsystem level 
optimizations directly. However,, each optimal subsystem participates 
in the system level optimization by means of its linear 
representation. 

The procedure terminates when all constraints in the system and 
subsystems are satisfied and the objective function ■«s a minimum. 

The decomposition IS achieved by optimizing jhsystems to obtain the 
best possible satisfaction of their loca-1 constraints consistent" with 
the parameters imposed by the system, and f.'-en constructing their 
linear representations to be included in optimization of the system. 


2 . 


3. 


4. 

5. 


Generalization to Multilevel Systems 

In many engineering systems, the number of levels required to reduce the 
suboptimization problems to manageable sizes may be greater than two. 
owever, it is straightforward to generalize the idea to more than two 

J/^^^®e-Jeve1 system is illustrated by the Venn diagrams shown in 
pg. 4. The cluster drawn with a heavy line is the two-level system 
introduced in fig. 3 and discussed in the previous section. That cluster is 
now a part of a more than two-level system whose description requires a 
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1 


s^0.| where $2,1 pt^s Jdl’rofl^ef e tjstem ee^Sj’? “t T 

afwi-S3^3 ace subsystems e ^ arm ^,1,^3,^^ 

To proceed Mith tbe method one must! 

1 . optimize the cUister composed of subsystem <;«. , a„wr ^ w u- 
subsystems So , c ^‘^^system ^2^1, dud subordinated 

st: 

r.^.. taken to be the cumulative const cai nr (on 

representing constraint unsatisfaction in- the entire cl ustlr 
cohsequently, the optimitetioe of Sj , (s LfJJed bJ ^ i ’ 

eT' 2? I2T 

ate o2^2> ^2,3* •^••^2,j» etc.- 

analysis of each optimum S? ,• to construct 
'^P'*esentations to be used in optimization^? ^ 
linear representation of the $2 i subsystem *are 
s2bo;d?b«edT“«:“‘'‘'"* the closer ' 

system in a way analogous_to the system 
?Sli:;«»°;b]ect?«*™„'«?oh. « “^'th tncludet 

*.5’®'-erch>- of unlimited 

:nh’TU%^;\~ 

TMrs^orS.iweiiJ 

linear representations together iith^th^mJ^ri^'^r-"^'^''^ percolation of their 
system remains to be optimized orSe t% Srtlirwrartd"!’""”’- 

9?“ven fJ%te*Sre«eS"^ tame as those 

them reformulated as follows: optimization with the last of 

corr«;;:d1nnaJ:nrUJ:^s‘5lfrreJrh4ri» 


KEY ELEMENTS OF THE METHOD IMPLEMENTATION 

wa? sJitLirfof\oIpS?‘"impfem?ntation^‘^ formalized in a 

section is given in terms formal ization described in this 
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- hierarchldl structure 

- nodes,, and eliisters of nodes 

- des4gn and behavJ-or vartaWes 

- parameters 

- interaction quantities 

- objective function- 

- operators 

- iterative-procedure 


Each of these entities is defined and assigned a FORTkAN-J ike 
restated in the List of Symbols). 


notation 


(also 


Hierarchial System 

tdlSifT structure, one may 

^ composed of a parent system. PS., and subsystem $S ^ 

The Identification IS recursive so that any node can be ^signated PS for an 

®''® 5"^’ it may also be designated an SS 

subordinated to a node at a higher level. This recursivitv i? pccentiai tn 

S^neLed^^^El]!^^ expanding the hierarchial structure downward and upward 
as TOeded. Each- noot in the hierarchy is identified by two-element inteoer 
posUvon vector, NID, stating a level number from top (top level is desiqnated 
as 1_) and honzonta-l position from left. The notation PID = NID and SSID = 
ID IS used when a given node is referred to as a parent and a subsystem 

= 5°'' "odiirkid 

= 34 PIO = NID - 2.2 . and the ofie marked with SS has SSID = NUJ 

of nodes are shown in figure 5 in the dashed-line 
envelopes. Nodes in a cluster are subordinated to a single cluster parent 
node on top of the cluster hierarchy. In the extreme, the eSure systeTl a 

I" other extreme, a cluster^ bl 

degenerate and consist of only one node (e.g., node (3.2)). The entire oraoh 

eScrunitrp't^ described in a tabular form shown in Table I. in 2hi?h 

each unity entry represents a link between the nodes designated on too and 

i-ntllctlons P^rent-subSstem ^ 


Design Variables, Parameters, and Behavior Variables 

IlJp ^ parent system are defined as the quantities which 

system an optimization algorithm in the optimization of parent 

^ subsystem are defined as the quantities which are beina 
Thpu^a^ n® algorithm in the optimization of a subsystem 

Th®y are collected in a vector denoted Y, and, optionally, Y(SSID) 

Symbol V is used to denote both X and Y. 
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eleweots ia vec^tors dervS^ ^nrf subsystem. They are- 

papent systero_end subsystem, respecti vely°^ and H(SSIO) for- the 

chacactwize the state 

variables- are usT^w for«lai^l«l?;L°“*'’“‘K^^ ‘5' node- analysts, these 

describe jiutual influences amono the nnH«*’"Th '’JJ?‘^*!“®-f“nttion^ and to 

elements of a vector deSoLr^S® I?® behavior variables are 

parent system sJbs^Tem resoKtl.el’J’^^''^^®^ ®"“ '(“ill), for 

auusyb tern, respectively, recognizing that B = B(V,H)._ 

Parent-Subsystem Interactions 

i;5l''a^i'aTe''Se?fned“s'?h™se Ltvlf «'•'»'>’« «f » 

of a parent syst™ Oh each 0 ? Us s S vs?Il*S'*^ mfloence- - 

analysis input. They are collectp^ being a part of the subsystem 

QI (PID,SSID)L collected in a vector denoted QI, and optionally, 

synl,J“n;"asTgo“i.«\':u? «v‘Jh‘LS ® 

subsystems of that parent. For conceptuaT Uniform!? 

data win be regarded as havino fhrn.mh^?^ approach, such- 

therefore, will be categorized ^as QI^ Is and,__ 

in Table IV, entries QI and X._^ ’ ^ illustrated by an aircraft example 

”'partl“oUr "o'^r:naij:js‘:l'l^Lrls°?r;ii1na1‘’'-'"''%^” ‘'■®‘ 

t.« additioJal types o? uE°^ cJun La„\,'t"?«l "S'" infrodoctns 

Qoantity and a N^fwork Int"EEaEEE^°"Q2aEE5jJ. ^ Interaction 

subsystem analysis and represent the 1nflue???^if output of a 

system by being a part of the Jnout iZ ??? L?I f^^system on Its parent 

collected In a vector denoted RQI and, optlShalW ^ROHPirslml^’ 
analogously to QI(PIO,SSIl)). L optional ry, RQI(PID,SSID) * 
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Network loteractlon Quantrities form a subset of the set~of beha>iior variables 
of a oode-and-are defined as the pivysical quantities which a.re the output of a 
subsystem by constituting a part of the other subsystem's analysis input 
directly, bypassing the parents of the two subsystems involved. 

These quntities are collected in a vector denoted NQJ and, optionally, 
NQI(SSI0 i,SSID 2) to indicate the direction of the influence from 
subsystem identified by SSIDi to subsystem identif ied-by SSID2. 

The definitions of KQI and NQl_ are included— in the body of the report for 
completeness. However, explanation of how they can be included in the 
procedure is deferred to Appendix B. 


Objective Function 

The objective function is defined in two different ways: For the parent sytem 

of the highest level (PID = 1,1), the objective function is the measure of 
goodness (figure of merit) for the entire hierarchical system. In other 
words, this objectWe function is the same one that would have been chosen if 
the- optimization without decomposition were to be performed. For each of the 
subsystems, the objective function is the measure of constraint unsatisfaction 
defined by eq. 5 for the given subsystem and all subsystems subordinated to it 
(an entire cluster). The objective function is denoted by F, and, 
optionally, F(PID) and F(SSID) recognizing that F = F (VL,H). 


Constraints 

Constraints of optimization are stated in the form of inequalities and 
equalities.. The constraints are denoted by: 


G .4: 0, E = 0, and, optionally 
G(NID) 0, F(NID) = 0 

where 


G = G(V,H), 
and 

E = E(V,H). 


H 
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Operators 

J>t- referred- to as 

^araiSfira aen^rirs^se. These operators are computer program- 

rrSJ?:rdSnrr^ThS ^a^rd^irsoi^r 

Sh^racter 0. followed by a list of Input and output variables, in that order, 
grouped in parentheses. 

E-iiriirS^^ 

However, for each node there is only one vector ROi. 

The operator Is denoted by pAQ.^and, optionally 

where^ Ql, RQI and. NQl stand for all vectors QI(PIU,SS1D), 

RQUPIO.SSIDi), and HQUSSlOi.SSIOj). respectively. 

?^/„s;;rrist be 

«pablenLjnatching the pAQ's with the appropriate nodes. 

Constraint operator.- This operator computes those behavior variables whose 
comoutl^ r r^ l^^ ncl uded in the node's 0A(i_ operator and evaluates the 
nS constraints. The operator is denoted by 0AC. and, optionally, 
j3AC((V,H,QI),(G,E)). 

itself. - 

operator is denoted by 00BJ, or optionally, 0PBJ((X,H) 4- Il- 
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This operator solves an optimization problem for a 
node in the hieran^y graph showo_Ui_fig. 5. In a standard notation, th^ 
problem is; 


min (|i(V,H) 

IV 


V. 

stO: 


1 ^ 


< 0 
0 


(9a) 

(9b) 

(90 


The meaning of V and H, and the -definition of the objective function 
t depend on the position of the node being optimized in the system 
erarchy. Two types of position are distinguished as follows: 1. A node 

positioned anywhere except on the top of the hierarchy, and 2. The node 
positioned on top (e.g. node 1,1 in fig. 5). 


Case 1: For node i subordinated to parent node j the- variables V = Y< 
and parameters H = Xj of the parent node*. The objective function is a 
penaTty function representing the constrain-t violation, ^ = P(Y,X), eq. 2, in 
the node.. - If the node being optimized—is a parent of a nondegenerate cluster, 
then Its penalty function includes the constraint violations in all the nodes 
in the cluster subordinated to it (eq. 5). These violations are evaluated by 
linear representations of the subordinated nodes (eq. 4).. 


The inequaTity constraints in eq. (9b) are the same as in eqs. (8b) and (8c), 
except that the vectors {Y,} are included from all subsystems in the 
cluster. The equality- constraints in eq. (9c) arise from the relationship 
stated, in eq. (2a) which exists between -the variables of-tlis node and its 
parent. 

The optimization operator executing with the aforementioned definitions 
of V,H and will be referred to as executing in mode 1. 

Case 2: For the parent system on top of the pyramidal hierarchy, the 

objective function is the one for the entire hierarchical system, <b = F. The 

design variables V £ X and H ; H, where X and H are design variables 

and parameters of the top node of the hierarchy. The inequality constraints 

in eq. (9b) are the same as in eqs. (8b) and (8c), except that the vectors 
{Y^) are included from all subsystems of the entire system. The equality 
constraints in eq. (9c) exist only, if required by the system level 
optimization problem at hand; they do not arise from eq. (2a). 

The optimization operator executing with these definitions of 4., V, and 
H will b-* referred to as executing in mode 2. 

The optimization operator is denoted by 00PTm or* optionally, 

(Jj3PTm( (H) , (V,(j> ) ) where V and 4 denote optimum values of the design 
variables and objective function, and m = 1 or m 2 indicate the execution 
mode. In its execution the optimization operator calls the operators 00BJ 
(in mode 2 only) and 0AC. 

The operator is defined as a "black box," therefore the optimization procedure 
It uses to solve ecj. 9 cdn be freely selected and need not be specified in 
detail here. It is conceivable that several optimization 
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^ t^Omnuo specUIUe, 

opefotors-^itH- the nodes Jecessary ta .natch th^ 

pn>cedure itselX. "'»sx-oe_provrded tot_ln the overaU optimUatSoo 


sensit ivity analvsi*; nnopa#.^« 

operator calcul 

»o<te 1 s„i.jrd?iiL rpL«'^r*r%j‘ sp<«^'«ca..y; 

derivatives- of a. and V with 2= •* "P^fatof «iU- o 
eperator-is denotfVd b. («^»((H!5.aT'^(J5/a%!;:/?JT*’ 


r - j w ^Y/ w.ij y ^ 

consists Of a repetition 

is''SsuBSM*'^ '■*PPPc?"‘dtiori^their'^parents '“N^tatil'fn^ IT produce 
°r? oP^^onally. 0SUBSW(C3PT1 0SKK^ operator 

cans f^ appncation o^ppn urjkS!‘f> ‘PPt 


r">(P™T“'l" ^'P|0L1°'^“ “PPMtor perforins the followins tests: 
For each node: 

prescribed ^for la^i fonstraint'Sf elch^na^" “p 

««- ai. L^i:fted™^,e^S;:?a^i“‘ v" »' ‘--p Procedui, 

repetitions of the Procedur^; 


Overall Iterative Procedure 


with de!o5osi?|^® Xn te‘j?esent'^ in*] “P‘*">*pp‘'P" 

4. ’ EwcuT'SsUBLfwJn.KE'T ''“' "”‘’®'' 

5. Row number reset to next higher level 

0* If the row number is nnf i u « f 

otherwise continue ighest level), repeat from 4, 

7. Identify <{, = f 
d. Execute 00PT2 

9. Execute 0TER 

10, Repeat from 2, unless 0 TEr inH-i,.:,* 

continue ndicates end of the procedure, then 

11. Final analysis: 

11.1 Execute 006j 

Execute 0ASW 

1K3 Execute (JAC for all nodes of the system 


^ I vr 

A block diagram in fig. 6 shows the r;ime. i • 

proced-re. callwg hierarchy of the operators in the 
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Coftcludinij the proce4ure cief.criptloh, it should be emphasized that the 

nit tons of the operators ylven in the foi^yoin^ are introduced primarily 
for the conceptual. purposes. These- definitions are by no means meant to 
prescribe rigidly the detailed allocation of functions to the code modules, 
that allocation be+ug clearly an implementation decisi-on to be .iiade in 
consideration of a number of computer software and hardware factors not 
included ui the scope of this report. On the aggregate, however, the method 
imp1einentati.on should have- all the functional capabilities called for by the 
operator definitions. ^ 


STATUS OF KtY ELEMENTS OF THE ME 'HOD 

The previous discussion referred several times to self -contained operations 
which constitute the key elements for the proposed optimization procedure. 
This sec tion s ummarizes the state-of- readiness — for these kp>' elements. 


System and Subsystem Analyses 

In the context of the decomposition scheme, the purpose of the analyses is to 
calculate the behavior variables which, in turn, are used to compute the 
interaction quantities (gi, RQI and NQI), the equa-lity and inequality 
constraints (G and E), and the objective function. Elements of such analyses 
are embedded in the operators PAQ, pAC, and PPB.J; they are entirely problem 
dependent add- not a part of the proposed development, except where needed to 
carry out the test cases. Examples relevant to aircraft optimization are the 
generally available programs for finite-element structural analysis, including 
substructuring, computational aerodynamics ^ and aircraft performance 
analyses. Programs described in ref. 14 constitute an example of the latter. 

Although it Is preferable, for obvious reasons, to obtain the needed behavior 
variables by analysis. Intrinsic modularity of the decomposition scheme allows 
substitution of experiment for analysis wherever necessary. 

It is desirable that the analyses be capable of "generating derivatives of the 
behavior variables, in addition to the variables themselves, preferably by 
efficient analytlcdl techniques* Example of algorithms for such derivatives 
are c^putation of derivatives of stress with respect to cross-section areas 
described in ref. 5 and a technique for obtaining derivatives of the pressure 
coefficients at a given wing location with respect to the wing planforin shape 
variables (e.g.: aspect ratio) described in ref. 15. 

Optimization 

Numerous mathenifitical programing techniques embodied in existing computer 
programs are available to perform optimization which is the task of operator 
pii»PT in mode 1, (m -= 1), and mode 2, (m = 2). The program CONMIN (ref. JO) 
based on the usable-feasible directions algorithm is one natural candidate for 
^ black of the (30PT operator. Implementation of CONMIN 

in 00PT may be facilitated by embedding it in program FRANOPP described in 
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The effect Iviinoss of t.ho- usc'-of penalty function defined in eq. 'd ha*; t,sen 
well estabUshed in the numerous re|>ocf.s on the Sequential Unconstrained 
Ninind-zation Technique (SUMT) wititan exterior fleo+slty function^ Favorable 
experience-with tlie-use of such a penalty function instead-of many individual 
constraiftts in the us tbl4i"feasihle direction algorithm (program- CONMUij was 
rofiorted in ref. 0. An oxample of an optimization w mode 1 was given for a 
th-in-walled beam in ref,^U, using numerous local design variables, and 
constraints on stress^ lQcaIJui£kling,_afid cros geometry. 

However, by its very natiw'e the foraiulation based oti an exterior penalty 
function is nonconservative, a^ it Is (Uso Inefficient when tbe initial trial 
design is a feas4ble one. Kfficiency improvement and preservation of the 
design feasibility in such cases Is sne area that requires further work. 

It ma-y require exploration of altermvtive formulations for a sinqlu measure of 
the cons^traint violations; one such imiiasure appears to be suggested by the 
well-known Interior, and extended-interior penalty function formulations 
which) when started with a feasible design, efficiently generate a series of 
steadily iitiproving feasible designs, in a conservative fashion toat many 
engineers prefer in conducting a design pr'oeess. 

At the subsystem level, the optimization operator must account for the 
equality const rairrts. The equality constraints (eq. (<Ja)) may be satisfied 
exactly, preferably by a design variable elimination technique whenever 
analytically possible or by one of the specialized optimization procedures. 

An example of the former is given In ref. U (the case of a thin-walled beam), 
a few techniques of the latter category are described in refs. 5 and 18. As 
an alternative to the exact satisfaction of the equality constraints in ever“y 
execution of the optimization operator (referred to as a strict equality 
optimization mode), it is possible to relax the strict equality requirement 
and to include the squared residuals of the equality constraints in the 
penalty function (cumulative constraint^ eq. 2). This alternative (referred 
to as a relaxed equality optimization mode) will lead to a satisfaction of the 
equality constraints when, but not necessarily before, the whole procedure 
converges. A satisfactory experience with this alternative has been reported 
in ref. 2 for a two-level optimization of structures built up of 
tension-compression components. 

In case the reverse interaction quantities (RQI) exist between a subsystem and 
its parent node, they will give rise to equality constraints st the parent 
node level. These constraints represent a requirement of vanishing difference 
between the RQI values assumed before the given subsystem analysis is 
accomplished and the values obtained from that analysis. Example of such 
equality constraints and a demonstration that they can be satisfied 
iteratively are given in refs. 19 and 20 for the problem of aeroelastic 
loads. In this problem, the RQI is the shape of an elastic aircraft 
deformed due to the aeroelastic loads which themselves are influenced by that 
shape. To account for this coupling, two aerodynamic shapes, one used in the 
aerodynamic load arralysis and the other obtained from str*uctura1 analysis due 
to these loads, are being Iteratively brought into a match. 

Conceptually, an RQI such as the one discussed above could as well be 
identified as an NQI. Consequently, the results repor'ted in refs. 19 and 20 
appear to indicate that inclusion of the network influences, t'iQI, will not 
keep the overall procedut'e from converging. 

The proposed decomposition procedure calls for use of the piecewise linear 
approximations (e.g., eq. 4) which implies that te operator 00PT will carry 
out its optimization task (in either mode 1 or mode 2) entirely, or at least 
partially, in a piecewise-Tinear manner whose effectiveness is well documented 
in refs. 4, 6, 10, and 21. 
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Optimum Sensitivity Analysis 

This analysis, performed- in the operatoc- (5SEN has been described in ref. 11, 
and-has been implemented- in a general purpose experimental computer code which 
was tested, on a- number of exam^es with- satisfactory results. To function as 
a part of the operator 0SEN, tt»e program-required the- following improvements! 

1. automating selection of the active constra-ints 

2. automatic elimination of linearly dependent constraint gradient 
vectors- 

3. implementation of of a linearized version of the optimum 
sensitivity anaJysis whose input does not require the costly-to- 
compute second derivatives of the behavior variables. 


Termination and Sweep O perato rs 

These operators (0TER, 0ASW and 0SUBSW) are conceptually straightforward. 

They may take form of high-level language codes or, optionally, may be written 
in an operating system control language, dependently on the organization of 
the entire procedure (see section Execution Control, Data Management and 
Hardware Implementation). 


Overall Convergence of the Optimization Procedure 

The sensiti-v-ity ajnalysis provides a very powerful extrapctlation tool for 
predicting changes to the optimuia solution caused by changes to the problem 
parameters. For highly nonlinear structural optimization cases, the accuracy 
of extrapolation represented by eq. 4 was demonstrated in ref. 11— to be very 
good throughout the parameter changes of the order of 20 percent. 

In view of that finding and a success with a two- level approach reported in 
ref. 2, prospect for fast overall convergence of the proposed multilevel 
optimization procedure appears to be very good. However, no proof of 
convergence is available and it is doubtful that one can be developed for an 
entirely general case, in which local minimum and disjoint design spaces would 
have to be considered since the design experience indicates that they do occur 
in optimization of engineering systems. Nevertheless, if the proposed method 
can be shown experimentally to produce a sequence of "improved" designs, then 
there should be no difficulty in formulating "practical" convergence criteria 
by which to decide when to terminate the process. 


Execution Control, Data Management and Hardware Implementation 

Since the decomposition procedure calls for iterative execution of computer 
programs organized in the afore discussed operators, numerous loops, branches, 
and other standard software constructs will have to be coded. In the general 
case, the computer programs will mostly be stand-alone, existing codes too 
large to be turned Into subroutines to a main program. Consequently, to build 
the desired constructs, one can choose among the following software executive 
capabilities currently available: 
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refepence'^2S,^wblch^is*^a^Jt?^^ Analysis Language (£AL) 

ard data of the saSe namef ^ systK?- 

4 »at1on"^:f 

StH?aj?SlS 

r^e the IPA&^re?^^13wftr^J^ available in^EAL^^rtf^^ — 

W^tate a„d finar f- f «1utfo-,. Regartt^* tte 

graphics utilities, together with appears that IPAD- off^ed^“ 

hI?S!J« “equate/" "P^tatfa, systan. 

Minframe computer! T a°I/uom^5™f°**J'j?- P™e“"te may be done solely „ a 

pta‘fTets"m^„t;e"n?!^ L^Ttbf d““^ 

the latter may emerge as a pteferrl5°al?e!wt°?,eT“‘’‘ cotputtng, 

iSt1i"^’-r-V" »„g"Set.orn"f Se""'*"^ — 

™en°!e""!a'J “cert"! ed*'' eolelua^nj?-."'' 

convergence, can be explored exper,^„talf;^‘V“iL/-al^3NV\t»-r?Ji„ ^ 
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DECOMPOSITION METHOD AND ORGANIZATION OF A DESIGN PROCESS 


Tte acceptance of proposed method , with its wide range of applicability 
wt-11 depei^ not "only oo. its use as a-oew tool_by designers -but even more 
importantly- on Us use by managers of design orgdnTzations.- A few factors 
iiKei y to aff ect that acceptance are examined below. 


Compatibility with a Design Office -Structure 

In contrast to "all-the-variables-in-one-basket" approach which would-hide the 
optimization mechanism in one mysterious 'lilack box," the multileveL 
decompositton makes contributions of all the disciplines clearly visible and 
therefore should fit very well the natural division of the design functions 
among many specialty groups cooperating with each other. The- obvious 
ftc7Z\ between the system hierarchy diagram, such as the one in fig. 

A5(b>,. and a typical design of^e organization chart supports, that 
assertion. Each node of the hierarchy diagram can be equated with a group of 
specialists, equipped with their tools,, intuitive judgment, methods, computers 
and, yes, experimental facilities. 

Along with that- similarity, the approach brings in some new elements which are 
likely to have, a profound and positive- impact on the way the design decisions 
are made and compromises reached in the inevitable i nterdisci pl inar y 
conflicts. These new elements are as follows; 

1. Each group designs their subsystem to specific requirements 
repre^ted by parameters H = X prescribed from the next higher level, with 
the objective of minimizing the measure of violation of the subsystem 
constraints (the cumulative constraints).. That ob-jective,. which replaces a 
traditional, disciplinary measure o£ goodness (e*g,, minimum weight), is 
pursued through repetitions ot the entire procedure, reducing its value to a 
.If®'* '"inimum in each repetition until it reaches zero— an indication 
that all constraints are satisfied. Example of this might be a structures 
group where one iteration task might be to design an airframe of a prescribed 
mass, loads, and external shape to minimize cumulative measure of violation of 
constraints such as stress, deformation, and flutter. 

* analyzes its optimal design for sensitivity with respect 

to the prescribed parameters. 

higher level node (parent system), the amounts of 
violation and the sensitivity derivatives from all the subsystems subordinated 
to that node are used to perform the parent system optimization. This 
optimization resolves the tradeoffs between the subordinate modes in an 
entirely objective manner on the basis of the optimum sensitivity derivatives. 

sensitivity information needed to resolve all the trade-off 
problem^ posed in the entire system design rises to the very top of the 

hierarchy where the objective function and constraints for the entire system 
are considered. ^ 
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Iji the Dcocess. ettafi»6ers dt each teVeV have fulJ visihllity of 
^^‘fua^owledge (If tte sensitivity Uforaatlon concerning tHeir sn^syst^^ 
and its cluster, ot subsystems at the- levels below*. Along w»th responsibtlity 
their result^ they eUo ret a to choice and controls of their tools a^ 
MtnSSr to perform' aftieinentioned tasks 1., 2^ and 3- RemarkaMy, this choice 
may inclJide also the use of expe rimen tal methods. 

Efficiency of the iiieracchial organization requires» logically, 

tcansferr^ quickly and that work at various nodes be performed m ^2 

the largest possible extent. These requirements, 

manaaement of data and for parallel computer processtng.. In , 

latter brings about the issue of synchronous vs. asyncilronous (chaotic) modes 

of operation. 

Synchronous Operation Mode 

In a synchronous mode, which seems "natural'-to anyone used to the 
conventional iterative algorithms, optimization of a given parent system is 
not attempted before optimizations and sensitivity analyses are completed for 
Mch of ^Srsutoys^^^^ the subordinate cluster. This is a Preferred mode, 
but only if all the subsystems require approximately the same time for ^ 
and sensitivity analyses, on it these operettas t^e so little 
time that waiting for the “slowest"- subsystem results does not matter, 
otherwise one may consider an asynchronous mode. 


Asynchronous Operation Mode 

Tn this mode optimization and sensitivity analysis of a parent system proceed 
when the optimization and sensitivity results from most, but not necessarily 
all of the subordinate subsystems are available. The fw subsystems 
are’ late with their results are temporarily ignored until J-'® 
tS include their information arises* It is easy to predict, that those 
subsystems in which experimental work is involved would be especially, but not 

sollly, prone to fall into the "slow" category which . the 

intermittently instead of consecutively to the successive iterations in the 

process. 

An encouraqing precedent for the notion that iterations based- on such 

intermittent contributions do converge is being found solution 

so-called chaotic iterative methods recently proposed (ref. 26) for solutwn 

of large sets of simultaneous equations by ^ ^ 

microprocessors. Furthermore, one may argue that although the optimum 
SJu?Se3 brali asynchronous optimization will probably be from one 

obtained by a synchronous optimization* it will not necessarily e 

This assertion is based on the following reasoning; In general, the original 
(nondecomposed) problem may be nonlinear and nonconvex, therefore, lo 
lininS S occir. Hence, the optimization result (discovery of one local 
minimum or another) is search-path dependent, the path taken being 
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affected by the choice of the synchronous or asynchronous mode. However, 
eUhougti different paths may lead, to a ditferent local minima, there is no 
reason to expect that*, intrinsically, the path corresponding to one- particular 
mode-will always lead to a superior local minimum. 


Summary of Advantages 

in sutranary, the multilevel decomposition viewed in. context of the organ i rati on 
of the design offers tbe following advantages:—,. 

1. The engineering specialty groups retain control over their tasks, 
including the methods and tools. Consequently, creativity, insight, 
and- responsibility for results are promoted rather than being 
impeded, as would be the case in the all-in-one optimizat.ion which, 
would be perceived as a "black box" tak-lng over the engineer's task^ 

2* Because of the independence of the choice of solution methods and the 
possibi.lity of using the asynchronous mode, experimental methods may 
be included. 

3. Visibility of intermediate results at_al I levels and a clear picture 
of the trade-off trends is assured. 

4. —Advantage is taken of the opportunities provided by computer 

technology such as the parallel processing and the organized-means of 
data management. 

Implementation of the multilevel decomposition method may be visualized as- a 
network of computers of various, judiciously chosen* types organized in a 
hierarchial structure underlying a similar structure of a human organization 
which uses the method as a tool in design of a complex engineering system. 


TESTING THE METHOD 


For a successful implementation of the proposed multilevel optimization 
method, two types of testing are needed. One of them will be a routine 
module- by-module verification of the code correctness, mandatory in any 
software system development. The other type of" testing should address the 
conceptual uncertainties and generate experience to guide the implementation. 
For this type of testing, one may propose working out a few physical examples 
as well as a more abstract simulation which- are described below. 


Physical Examples 

A portal framework used as example 1 in Appendix A would provide a good 
development test case. Its testing should consist at least of the following: 

1. Ortimization by the all-in-one approach- starting from a few different 
initial designs to establish a benchmark optimal design (or designs 
if local minima are found). 
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Z. U a_4isabie=ifeasiJjle directions, opttniization tectmlque is to. be ujied, 
then tbe- optimization, sbou Id. be restated vrttb. a- cumulative constraint 
(eaa_2) to_ascertain -lts-4nf4uence- on the benchmark results « 

3. Repetition of~the optimizati^in usln 9 a piecewise- 1 inear procedure to 
eval uate its in fluence on the benchmark results. 


4. Final ly^ the multilevel optimization, to compare its convergence, 
efficiency, and results with the benchmark case* this comparison in 
conjunction w-ith the data available from. tests 2 and 3 will reveal 
the extent to which the inevitable discrepancies-are caused by the — 
multilevel approach, rather than by the use ot cumulative constraint 
and piecewise- linear procedure which are auxiliary t ools incidental 
to the very concept ol the multilevel decomposition*. 

A simp.lified aircraft optimization. describecLas example 2 in Appendix- A would, 
provide an opportunity for testing multidisciplinary influences, A benchmark 
result could be obtained by one-of the existing aircraft synthesis codes, 
e*g.,^ program described in ref. 14. For consistency of comparison, the level 
of de^il of the aerodynamic and. structural analyses in the multilevel 
optimization should be the same as in the code for generating the benchmark 
result. 


Simulation ot_ a Multilevel Optimization 

The primary purpose of the simulation will be generation of operational 
experience with various configurations of- the system to be optimized in order 
to explore the new, previously untested aspects of the entire method- and guide 
its implementation. The major untested aspects that cannot be ascertained 
theoretically and, therefore, need to be investigated experimentally are: 

1*_ Overall convergence of the method 

2. Influence of the interactions RQI and NQI on the convergence 

3 *~ Computational costs-savings of the multilevel approach relative to 
the all-in-one approach 

4. Relative efficiencies of various computer organizations of the 
procedure and user-oriented features of its input and output 

5. Feasibility, accuracy and efficiency of the parallel synchronous and 
asynchronous modes of operation 

To perform these tests quickly and inexpensively, only analytical functions 
should be used in the nodes of- the simulator system. Initially, the functions 
for simulation of- the node constraihts and the system objective should be 
chosen to be convex in the X and Y domains in order to avoid the multiple 
local minima problem. To assure ease of code modifications, the entire 
simulation program should be coded in-core in the form of a main program 
calling subroutines, even for simulation of the case of parallel 
computing on distributed processors. 
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are -part of tl» tfe«eJop«ent propra* DeyZ lie °lo^efthl“leion.^”^*^ 


COMCUSIONS- 


are treated as parameters in_tl.at subs^Xem^oStTmiHtiJJ.'"®^*'' 


APPENDIX A 


FXAMPLES OF DEGOMPOSITION 


Three examples- provided in this appendix illustrate decomposition fon 
optimization purposes^ The examples are minimum mass optiraization-of a simple 
framework (which was discussed in an abridged form in section "Key Idea for 
the Decomposition"), minimum mass optimization of a wing-fuselage airframe, 
and an optimization of an aircraft for a minimura-of fuel consumed, to deii^ffir a_ 
given payload over a prescribed range.. Discussion of the examples is limited 
to the features directly relevant to the decomposition concept -with the 
disciplinary details, of analysis omitted. Oeneral -familiaaity of the reader 
with the-disci pi Inary technologies involved in the examples is assumed. 


Example 1: A Portal FrameworJt- 

A portal framework shown in figure.1 it an example of a hierarchial system 
that can be optimized for minimum mass subject to strength and displacement 
constraints using the linear decomposition approach. The decomposition is 
two-level and results directly from the fact that one can use an engineering 
beam theory to analyze the framework for internal forces (end forces- on each 
beam) and displacements, assuming that A(cm?) and ly(cnr) for each 
beam (or even ly alone, if beams are slender) are gi veo-but-without knowing 
the detailed cross-sectional dimensions (bj, ti,...etc.). These dimensions 
can be optimized separately for each beam as long as the end forces (fig. 2 ) 
in_each beam are known and assumed fixed. 

Consequently, the correspondence of the basic elements of the decomposition 
approach to the specifics of the framework example is immediately obvious as 
shown in a Verm diagram in figure AT; a hierarchy diagram in figure A2; and 
Table-il, which displays the one-to-one equivalences of entities involved. 
Example of a particular form of eq. (2a) can be given by cross-sectional area 
and moment of inertia as functions of cross-sectional dimensions for an 
I-beam: 


Z2 = h-(ti+t2)/2; Z3 » (h-t2)/2 

Ai » bitj; A 2 » b 2 t 2 ; A 3 * (h-ti-t 2 )t 3 

A = A 1 +A 2 +A 3 (Al) 

c * (A 2 Z 2 +A 3 Z 3 )/A 

ly = (bit5+b2t2+t3(h-ti-t2)3)/12 + Ajc^ + 

A2(z2=c)2 + A3(z3-c)2 (A2) 
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Exa«iple_2: A Ming-Fuselage Airframe 

Att- airframe comp'»sed of- an arrow- wi ng^ and fuselage (fi^re A3(a)) provi<fes- an- 
example of a. hteP.iPciT^cal structural system whose strongly, coupled subsystems 
ap si^tructures.- As shown in figure A 3 , the relatively long root chord of 
the wing in the arrow wing configuration-chosen for the example makes- the 
chordwise plate bending. of the wing couple with- the fuseUge bending and gives 
rise to interaction forces (Fj through. F5 in figure A 3 (b))L which can be 
computed usx^ e stiff-ness matrTJt- K shown topaloglcaUx figure Al(c)). 

element' of matrix K is a sum of s0ffness contributions from 
wing, K|jW,_ana fuselage, Kn - Kii(w) JfX, 

Consequently, the stiffness coefficients Ki|\w) and ,(<'). play 
the same role in the airframe substpucturing analysis as the beam 
cross>sectional properties A and ly in the framework analysis and become 
the system level design variables. . Assuming the airframe structural mass as 
an objective function to be controlled at the system level, the addUi-onal 
design variables are structural masses, Wvw) and w(n* of the 
the fuselage. 


wing and 


Similarly as in the framework example, the correspondence of basic elements of 
the ^composition approach to the particular elements of the airframe example 
IS shown by means of a Venn diagram in figure A 4 (a),. a hierarchy diagram in- 
figure A 4 (b), and Table III. Examples of local variables are shown in figure 


The chaice of stiffness coefficients as design variables Is- highly 
unconventiohal and experience is limited relative to its practicality. The 
ultimate proof of the proposed approach will lie in the test results. 


Example- 3 : A Transport Aircraft 

Design of aircraft provides an example for multilevel optimization of a 
multidisciplinary engineering system. For this purpose, one may Isolate one 
• aircraft optimization and present it here in a manner 

intentionally narrowed and simplified for conciseness. Suppose that the 
optimization task calls foi' minimization of the fuel consumed to deliver a 
given payload over a given range. One possible choice of the design variables 
is listed in two groups; (1) the wing area S, aspect ratio AR, airframe 
^ takeoff thrust Tq» propulsion system mass 

WU»;, fuel consumed WAJ), drag coefficient cnTp),„and the mission 
parameters of cruise altitude h^r and- Mach number Mcr. Assuming the 
above as the system level variables, a Venn diagram and a hierarchy diagram 
develop as shown— in figure A 5 (a and b). ^ 

The variables of group 1 (S, AR and w(^)) govern the airframe which is a 
parent system to the wing and fuselage subsystems, arid which was examined in 
the previous example. The diagram shows propulsion as a subsystem directly 
connected to the aircraft system and governed by group 2 of the system level 
Rfopulsion subsystem design variables 
lyiU.<^I...y^I2,Z)} need not be specified for the purpose of this 
discussion beyond meritioning, say, a compressor diameter and a turbofan bypass 
ratio as examples. 
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Correspoadence of the generic elements of~ the- decomposition approach to the 
particular elements of this example is glven_1n table. IV,. Notice that, unlike 
in the previous two examples, tbere-exists a reverse- interaction quantity 
(RQL) between the-nodes 2.1 and 1,1. This RQl represents irrfluence of the 
elastic deformation of the airframe on the aerodynamic loads computed at the 
system, level and calls for a special system level constraint. The function of 
that constraint will be to bring the aerodynamic. loads assumed as Input to the 
structural analysis Into equality wltlt the same loads corrected to reflect the 
deformed ahape which is obta1ned_as- output from that, analysis.. 

The Influence of an NQI type also exists In this example between nodes 2.2 and 
3.1 In the form of the engine weight influence on the wing structure- stress. 


29 


APPENDIX B 


HANDLING THE REVERSE AND NETWORK INTERACTIONS 


This appendix describes one possible approach- to the peoblem-of including the 
reverse and lateral Interaction (RQI's and NQt-'-s) among the nodes of a 
hierarchical « top-down system. 

An example of a system hlerarchlal diagram with the RQI and NQI existing In 
addition to the QI Is shown- In figure Bl. Problems caused by existence of 
the RQI and NQI are defined and their solution proposed. 


Problem 1; Vertical Reverse Coupling 

The probleiJL Is caused by existence of the RQI and can be described as follows: - 

For solution of, say, node 3.2 (diagram, fig. BL), one needs to know QI from 
solution of node 2.1, but that node cannot be solved unless the RQI from node 
3.2- Is available. 

The solution to the problem Is to assume an, as yet unknown, RQI » RQI*, solve 
node 2 J obtaining QI « QI* and then solve node 3*2, using QI* as- an Input, to 
o^in a corrected RQI = RQI** which In turnw^ilL result In a corrected value— 
of-QI. = QI**. Convergence Is obtained when the differences between the 
elements of the vectors RQI* and RQl**, and QI* and QI**^ diminish below an 
assumed tolerance. 


This convergence could be achieved by a separ-ate dedicated Iteration embedded 
In the overall optimization procedure. However, there Is no need for such 
ded1cat6d Iteration, because the task can be delegated to the optinilzatlon 
procedure by simply adding to the set of constraints of the parent node (node 
2.1 In the example In figure Bl) a constraint enforcing the convergence of. 
say, RQI* and RQI**, i.e., ^ 


g^ = llRQI**fl - ||RQI*1 4e 0RQI**l (Bl) 

where e is a small tolerance parameter. 

The Iteration toward converging the RQI** and RQI*-vectors Is clearly a part 
of the overall system analysis. Therefore, Its proposed blending with the 
optimization Itself can be recognized as the so-called integrated 
analysis-optimization whose conceptual and numerical validity Is established 
In the literature, e.g., refs, 5 and 27, and refs. 19 and 20 in which an 
elastic aircraft shape deformed by aerodynamic loads played Implicitly a role 
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Proble)H-2i Lateral Coupling 


The problem is caused by existence of the NQl and, hasically resembles that of 
RQl, tiierefore,. a similar ap proac h can be taken. Two subproblems need to be 
distinguished here. 

Subproblem A - a one-way lateral interaction .- For solution of, say node 
Jptd)» one .needs to know a cesuH of sotutTon Of node-(ro,n) (an influence 
marled by a dotted arrow in figure Bl) which can be solved without inputs from 
node (p,d)> 

Solution is simply that of tijning,^ if m < p. Node (m,n) (which is at a level 
higher than node (p,q)) iS- solved first and the solution of node (p,q) follows 
with the NQJ information routed directly from node (m,n) to node (p,q), e.g., 
from node (3.2) to node (4.T) in figure Bl. 

However, if m > p (a node at a. lower level influences a node at a. higher 
level, e.g., (4.1) to (3.3)), the situation becomes similar to the one 
involving an RQI and calls for asimilar solution. First time, one can solve 
the (p,q.) node for assumed vector NQI* ((m,n),(p,q)) and then solve the (m.,n) 
node to produce a corrected value of NQI** ((m,n) ,(p,q))to be used In the next 
analysis of the (p,q) node, etc. Convergence can be enforced by introducing a 
constraint analogous to equation Bl; 

gp = 8NQI**ll - «NQI*ii ^ e |NQI**K (B2-) 

in the optimization of the node which is the lowest level parent to both nodes 

(m,n) and (p.q). In the example in figure Bl, such node is node 2.2. 

Subproblem b - a two-way lateral interaction .- In this subproblem, each node 
in a pair (m,n) and (p,q) needs- aS input for its analysis the NQI from the 
other node in the pair. The solution- is to include in the optimization of the 

node vihich is the lowest level common parent of- the pair two additional 

constraints to account for discrepancy between the NQI** and NQI* acting in 
both directions 

gp = «NQI**((m,n),(p,q))y - » NQl*((m*n) ,(p,q))l 

4 e «NQI**((m,n),(p,q))« (B3a) 


gp+1 = BNQI**((p,q),(m,n))» - *NQI*((p,q) ,(m,n))l 

4 e »NQI**((m,n),(p,q))ll (B3b) 

and to assume the NQI* values in the first iteration. 

An example of such interaction is illustrated in figure Bl for a pair of nodes 
(3,5) and (4,2) whose lowest level common parent node is (2.2), 
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lABLE III.- CORRESPONDENCE OF THE GENERIC ENTITIES TO THE AIRFRIWE EXAMPLE SPECIFICS 
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for propulsion; detailed design variables' of engine 
e^g., number of the compfessor stages 

Parameters for the system # ■.■ ■ ■ m i . pfe^cribed range 

Parameters for subsystem ^ ^ » 2.'l Airframe: S, AR, 

2.2 Propulsion: T , l^rr* *^cr 
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vjure A2,- Hierarchy diagram for a framework system. 
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